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Abstract.  Many  theories  of  structure  from  motion  divide  the  process  into 
two  parts  which  are  solved  using  different  assumptions.  Smoothness  of  the 
velocity  field  is  often  assumed  to  solve  the  motion  correspondence  problem 
and  then  rigidity  is  typically  used  to  recover  the  3D  structure.  We  prove 
results  showing  that,  in  a  statistical  sense,  smoothness  of  the  velocity  field 
follows  from  rigidity  of  the  motion. 
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RIGIDITY  AND  SMOOTHNESS  OF  MOTION 


The  smoothness  assumption  in  measuring  visual  motion 

The  problem  of  measuring  visual  motion  is,  in  many  situations,  undercon¬ 
strained.  That  is,  the  information  in  the  changing  image  is  insufficent  to 
determine  the  motion  uniquely.  This  indeterminateness  is  often  referred  to  as 
the  “aperture  problem”  (for  example  Marr  and  Ullman,  1982).  An  additional 
constraint  is  therefore  required  for  resolving  the  ambiguity  and  determining 
the  velocity  field  uniquely.  An  important  constraint  that  has  been  proposed 
for  solving  the  problem  is  a  smoothness  constraint.  (Fennema  and  Thomp¬ 
son  1979,  Horn  and  Schunck  1981,  Hildreth  1984,  Nakayama  and  Silverman 
1986).  When  applied  to  the  problem  of  measuring  the  velocity  of  image  con¬ 
tours,  this  smoothness  assumption  has  been  formulated  by  Hildreth  in  the 
following  manner.  Of  all  the  velocity  fields  that  are  consistent  with  the  trans¬ 
forming  image,  select  the  velocity  field  that  minimizes  the  overall  variation. 
That  is,  if  v  denotes  the  velocity  at  a  point,  and  s  the  arc  length  along  the 
curve,  the  preferred  velocity  field  is  the  one  that  minimizes  the  integral: 

along  the  curve  (the  principle  of  least  variation).  It  has  been  shown  that 


this  method  of  determining  the  velocity  field  gives  good  results  under  a  wide 
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I  range  of  conditions,  and  it  seems  to  correspond  in  many  cases  to  the  velocity 

}  field  perceived  by  human  observers  (Hildreth  1986,  Nakayama  and  Silverman 


1986). 


Justifying  the  smoothness  assumption. 

The  main  rationale  raised  in  support  of  the  smoothness  assumption  is  that 
the  velocity  field  induced  by  smooth  contours  in  motion  is  expected  to  be 
smooth.  This  argument  is  insufficent,  however,  for  justifying  the  principle  of 
least  variation.  The  smoothness  assumption  implies  that  if  the  object  is  known 
to  be  smooth,  the  velocity  field  should  not  contain  discontinuities.  It  does  not 
imply,  however,  that  “the  smoother  the  better”.  Consider,  for  instance,  two 
points  in  the  image  separated  by  a  small  distance,  and  moving  with  image 
velocities  Vx  and  V2.  One  may  argue  that  if  they  lie  on  the  same  surface, 
extremely  high  values  of  ||Vj  -  V2 j|  are  unlikely,  because  of  some  physical 
limitations  on  the  motion  of  objects  in  space.  But  why  should  one  assume 
that  a  relative  velocity  of,  say,  0.2  deg/sec  is  less  likely  than  0.1  deg/sec?  Such 
a  preference  is  assumed  by  the  least  variation  principle  (that  favors  velocity 
fields  in  which  the  difference  in  velocity  between  neighboring  points  is  as  small 
as  possible),  but  cannot  be  defended  only  on  the  basis  of  a  general  smoothness 
argument.  Clearly,  a  stronger  constraint  than  just  the  general  smoothness  of 
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surfaces  is  required. 

Another  general  property  that  seems  to  provide  a  useful  constraint  in  the 
analysis  of  visual  motion  is  rigidity.  Computational  studies  have  shown  that 
the  3D  stucture  of  rigid  and  quasi-rigid  objects  can  be  recovered  by  looking 
for  the  most  rigid  interpretation  possible  of  the  changing  image  (Ullman  1979, 
1984). 

In  this  paper  we  argue  that  local  rigidity  of  the  object  and  the  principle  of 
least  variation  in  the  velocity  field  are  related.  To  investigate  this  we  consider 
a  rod  moving  in  three-dimensional  space.  The  rod  is  allowed  to  move  in  a  semi¬ 
rigid  manner:  it  can  rotate  and  translate  freely  and  is  also  allowed  a  certain 
expansion.  We  calculate  the  relative  velocity  between  the  two  endpoints  of 
the  rod,  as  projected  on  the  image  plane.  The  calculations  show  that  under 
a  wide  range  of  conditions  this  velocity  distribution  is  peaked  at  zero  velocity 
and  decreases  monotonically  at  higher  velocities.  As  a  result,  the  projected 
velocity  field  of  points  linked  rigidly  together  is  likely  to  be  consistent  with 
the  principle  of  least  variation  in  the  velocity  field.  There  are  two  factors 
contributing  to  this  strong  bias  towards  small  differential  velocities  in  the 
projected  velocity  field:  (i)  the  rigidity  of  the  link  between  the  two  points  and 
(ii)  the  effect  of  projection  from  3-D  to  the  2-D  image  plane. 

If  we  imagine  an  object  being  made  up  of  a  collection  of  semi-rigid  rods 
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this  analysis  suggests  that  the  projected  velocity  field  is  likely  to  be  smooth. 
We  conclude  that  the  principle  of  least  variation  is  a  reasonable  constraint 
that  can  be  justified  for  the  projected  velocity  field  of  rigid  or  locally  rigid 
objects. 

Section  1.  The  two-dimensional  case. 

First  we  consider  a  rigid  rod  moving  in  two  dimensions  and  being  pro¬ 
jected  onto  a  line.  Because  it  is  rigid  the  rod’s  velocity  can  be  split  into 
rotational  and  translational  components.  For  our  purposes  the  translational 
component  can  be  ignored  as  it  will  not  contribute  to  the  derivative  of  the 
velocity  field  on  the  line. 

Let  the  projected  length  of  the  rod  be  R  and  the  real  length  be  r,  the 
angle  to  the  vertical  be  9  and  the  angular  velocity  be  u.  Then  the  projected 
velocity  distribution  $(u)  is 

$(u)  =  J  6(R  -  r3ind)6(u  -  r{jJco6O)$r(r)$w(u)dr(L)d0  (1.1) 

where  6  denotes  the  Dirac  delta  function,  $r(r)  and  $u,(w)  are  the  distribution 
of  r  and~u>  respectively.  rsin9  and  rwcos#  are  the  projected  lengths  and 
velocity  respectively.  We  assume  that  rods  are  equally  likely  to  have  any 
length  between  0  and  rmar  and  set  $r(r)  =  k  between  0  and  rmax  (with 
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We  can  integrate  with  respect  to  9  using  the  first  delta  function.  This 
gives  (see  Appendix  1) 


*00  =  Lr  7r>  l-Ji6(u  -  u'v'f2  - R2)*u(u)dr<L,.  (1.2) 

We  integrate  with  respect  to  r  to  obtain 


$^(t j)cLj 
{R2u2  +  u2)i 


(1.3) 


where  u)m,n  =  u/\/rmax  -  R2-  This  lower  bound  comes  from  the  delta  func¬ 
tion  integration. 

Now  we  examine  the  behavior  of  $(u).  If  we  differentiate  it  with  respect 
to  u  we  get 


d*  _  r  u)  , _ ^(u>min) _  .  . 

du  Lw„„  (^y+ti!)J  W  {r2max- R?)2(R2u2mtn  + u2)' 

So,  for  any  probability  distribution  $u,(w)  (which  by  definition  must  be  a 
positive  function)  the  two  terms  on  the  right  hand  side  of  (1.4)  must  be 
negative.  $(u)  must  decrease  strictly  monotonically  with  u  and  has  a  unique 
maximum  at  u  =  0. 

Thus  whatever  the  distribution  of  the  rotation  the  mo6t  likely  projected 
velocity  is  zero.  This  result  is  similar  to  that  obtained  by  Ullman  (1979) 


for  the  motion  of  dots.  It  was  shown  that  if  the  motion  of  a  random  dot  is 
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described  by  an  isotropic  probability  distribution  function  in  three  dimensions 
then  the  probability  distribution  for  the  projected  two-dimensional  motion  is 
peaked  at  0. 

Note  that  our  result  is  independent  of  whether  we  choose  an  upper  bound 
for  r.  This  can  easily  be  seen  by  setting  rmax  i->  oo  and  u  *-►  0  in  (1.4).  In 
fact  having  an  upper  bound  for  r  makes  d$/du  more  negative  and  makes 
$(u)  decay  faster.  Henceforth  we  assume  for  simplicity  that  there  is  no  upper 
bound  for  r. 

To  see  the  connection  with  the  smoothness  assumption  observe  that  in 
the  limit  Hildreth’s  smoothness  measure  can  be  expressed  as 

/i£r*-E(J)*  <«> 

where  the  sum  can  be  taken  over  a  set  of  rigid  rotating  rods.  The  results  above 
show  that  for  each  rod  considered  independently  the  probability  distribution 
of  the  u  is  peaked  at  zero.  Thus,  with  this  independence  assumption,  we 
argue  that  the  most  likely  distribution  of  the  whole  contour  is  the  one  that 
minimizes  (1.5).  We  will  relax  the  independence  assumption  in  section  4. 

Section  2.  The  three-dimensional  case. 

We  now  extend  the  analysis  to  a  rod  moving  in  3-space.  Consider  a  rod 
of  length  r  projected  into  the  image  plane,  which  has  unit  normal  vector  k. 
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The  rod’s  direction  in  3-D  space  is  denoted  by  r  which  is  a  unit  vector  in  the 
direction  r.  The  rod  is  projected  into  a  vector  rp  where 


fp  =  r  -  (r  •  k)k. 


The  rod’s  rotation  is  described  by  a  vector  u>,  where  w  is  the  frequency  and 
w  is  the  axis  of  rotation.  The  velocity  v  is  given  by 


v  =  ut  X  r. 


The  projected  velocity  field  vp  is  given  by 


vp  =  v  -  (v  ■  k)k. 


We  consider  rods  with  projected  length  R  and  projected  velocity  U .  We  are 
interested  in  the  projected  velocity  distribution  $(f/).  Since  the  projected 
velocity  distribution  is  rotationally  symmetric  we  can  express  this  as  U${U) 
(see  Appendix  1).  If  the  rods’  length  distribution  is  $r(r)  and  their  rotation 
distribution  is  $w(w)  then  the  projected  velocity  distribution  is  given  by 


*(t»)  =  j  HR-  |fp|M(t/  -  (2.4) 

Care  is  needed  in  specifying  the  domain  of  integration  of  (2.4).  From  (2.2) 
we  see  that  only  the  component  of  Q  perpendicular  to  r  contributes  to  the 
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velocity.  We  must  require  Q  ■  f  =  0.  We  impose  this  by  substituting  a  delta 
function  into  (2.4)  and  then  integrating  over  all  u. 


Thus  we  have 


U*(U)  =  J HR-  |rp|W<3 •  ?)6{U  -  \vp\)$uj(u)drdQ.  (2.5) 

We  assume  all  directions  of  the  rod  are  equally  likely  and  the  rods  are 
also  equally  likely  to  have  any  length.  So  we  set 


*(r)  =  1. 


We  also  assume  that  the  rotation  is  equally  likely  to  be  in  any  direction.  Then 
$w(w)  is  a  function  of  |J3|  =  w  only. 


U$(U)  =  J  S(R  -  \rp\)6(u  •  f)S(U  -  \vv\)$w(uj)dfdu.  (2.7) 

Choose  an  orthogonal  basis  i,  j,  k.  Define  angles  0,  if,  a,  (3.  These  angles 
are  illustrated  in  figure  1.  8  is  the  angle  between  the  unit  vector  and  the  k 
axis,  if  is  the  angle  between  the  unit  vector  projected  onto  the  x,y  plane  and 
the  x-axis.  Similarly  for  a  and  /?.  It  follows  that 


*  A 


r  =  sinOcosifi  +  sinO  sintfj  +  cosOk 
u  =  sinacosfti  +  sinasinfij  +  cosak 


(2.8) 


Figure  1  Definitions  of  the  angles,  see  text. 
Then 

du  =  du>  sina  dadfi 
df  —  dr  sin6  dOd^p 

and 

|rp|  =  rain#. 

Define  the  angle  between  w  and  r  to  be  r  by 
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dudr  =  dudr  sinasinO  dad(3d$dip.  (2.18) 

The  integrand  only  depends  on  tp  and  (3  as  ip  —  (3.  We  can  set  ip  =  ip  —  (3  and 

integrate  out  (3.  Then  we  have 

cost  —  cosO  cosa  +  sinO  sinacosip 

cospsinr  —  sinO  sina  sinrp  ■  (2-19) 

dudr  =  irdudr  sinasinO  dadipdO 
Now  we  must  change  the  variables  of  integration  from  «,  ip  to  r,  p: 

(9a  9a  \ 

9r  dp  \ 

drdp.  (2.20) 

§£/ 

From  (2.19)  we  eliminate  the  terms  containing  ip  to  obtain 

cosa  =  cost  cosO  ±  sina(sin20  -  cos2  p)? .  (2.21 ) 

Define  functions  F(t,  p,a,ip)  and G(T,p,a,ip)  by 

F(t,  p ,  a,  ip)  —  cost  —  cosO  cosa  —  sinO  sinacosip 

(2.22) 

G(r,  p,a,ip)  =  cosp  sinT  -  sinO sina  sirup 
It  is  a  standard  result  of  Jacobian  transformations  (it  can  be  obtained  by 

using  formula  (2.20)  twice,  once  changing  variables  from  a,  ip  to  F,  G  and 


then  changing  F, G  to  r,  p)  that 
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dadxp  —  det 
From  (2.22)  we  obtain 


9F 

9F  \ 

/  9F 

dF 

ST 

ST  \ 

!  /det  [ 

'  ST 

€hjs 

9G 

9G 

1  \ 

,  9G 

9G 

ST 

Sp  ' 

V  Sa 

drdp. 


det 


dF 

ST 


9G  9G 

ST  Sp  ‘ 


=  sin2rsinp 


and 


=  sinB sina{sin<?  cosa  -  cosxp cosB sina} . 


dadxp  = 


stn‘r  stnp 


sinB  sina{sinB  cosa  —  cosxp  cosB  sina} 
We  substitute  for  cosxp  from  (2.19)  and  obtain 


drdp. 


dadxp  = 


stn‘r  strip 


sina{cosa  -  cosB cost} 


drdp 


then  using  (2.21)  we  find 


dadxp  = 


stnr  stnp 


sina(sin2B  —  cos2p)b 


drdp. 


Hence 


...  ,  .  sinr  sinpsinB  ,  , 
■sma  stnBdadxp  =  — : - - - - -drdp. 


(2.23) 


(2.24) 


(2.25) 


(2.26) 


(2.27) 


(2.28) 


(2.29) 
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We  substitute  (2.17),  (2.18)  and  (2.29)  into  (2.7) 


[/$(«)  =  J  6(R  -  rsin9)6(cosT)6(u  -  ursinT  sinp) 
sinrsinpsinO 

*«(*•>)—— - — j -drdpdOdudr 

(sin*0  —  cos*  pp 

Now  we  do  the  integration  with  respect  to  r  to  obtain 


(2.30) 


U*(U) 


6(R  —  rsinO)6(U  -  ursxnp) 
(sin26  -  cos2 p)$ 


sinpsind  dpd9  du  dr.  (2.31) 


We  integrate  with  respect  to  0  to  obtain 


/  S(U  -  ursinp)$UJ(u)sinp{R/r)  dpdu  dr 
“  ~  J  (r2  ~  R2)t(R2/r2  -  cos2 p)i  ' 


(2.32) 


We  integrate  with  respect  to  p  and  obtain 


lT)=  \ - 

J  r(r2  — 


R$u,(ui)dudr 

(r2  -  R2)±(R2lj2  +  u2  -  w2r2)*(u;2r2  -u2)*' 


(2.33) 


The  domain  of  integration  is  restricted  to  the  region  of  the  u>  -  r  plane  where 
the  integrand  is  real  (for  simplicity  we  have  omitted  the  bounds  of  integration 
in  the  previous  equations).  It  is  specified  by 


r  >  R 


R 2w2  +  u2  >  o>2r2 


wr  >  u. 


(2.34) 
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Change  the  variable  of  integration  from  r  to  X  where 


2  2 

u>  r  = 


u2  +  X 


(2.35) 


then 


Ru>$u(u)cLjdX 

X)*(u2  +  X  -  w2#)*(u2  +  X) 


with  domain  of  integration 


(2.36) 


X  <  R2  u2 


X  >  0- 


(2.37) 


u2  +  X  >  u >2R2 


Define  a  new  variable  Y  by 


Y2  =  u2R2  -  X 


(2.38) 


then 


_ Ru>*^)<L>dY _ 

(u >2R2  -  r2)i(«2  -  r2)i(u2  +u tR}  -  V2) 
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Y  >  0 

Y  <  ujR  ( 2.40) 

Y  <  u. 

We  can  further  simplify  this  expression  by  the  substitutions  Y  —  usinB 
and  u)  =  ( u/R)Cl .  This  yields 


*(«)  =  4  /* de  I”  <m- 

^  JO  J  iin0  ( 


*JuCl/R) 


(2.41! 


(fi2  —  sin2#)1 /2(fi2  +  cos29) 

It  is  clear  from  this  expression  that  $(u)  will  decrease  with  u  if  and  only 

if  <&w(w)  does  not  grow  faster  than  u2.  Thus  for  all  realistic  cases  $(u)  will 

be  a  monotonic  decreasing  function  of  u. 


Section  3.  Expansion  and  Contraction. 

We  now  consider  the  situation  in  two  dimensions  when  the  rod  is  allowed 
to  expand  and  contract  as  well  as  rotate.  We  can  write 

f  =  rr  (3.1 ) 

and  differentiating  gives 


f  =  ff  +  rdh 


(3.2) 


where  h  is  the  unit  vector  perpendicular  to  r.  We  define  the  expansion  coef¬ 


ficient  s  bv 


.  %  •- 


•v 
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and  write  (3.2)  as 


r  =  rsr  +  rOh. 


The  projected  velocity  is  then  given  by 


U  =  r  ssinO  +  ru cos$ 


where  0  is  the  angle  that  f  makes  with  the  normal  to  the  image  plane  and 


9  =  u>.  The  projected  velocity  distribution  is  given  by 


$((/)  =  J  6(R  -  rain9)6(U  -  (r  s  sin9  +  rucos0))$,(3)&w(v)dr  dudadB 


where,  as  in  Section  1,  we  have  assumed  that  $(r)  =  1  so  the  rods  have  no 


preferred  lengths.  We  do  the  integral  of  Q(U)  with  respect  to  9  to  obtain 


*(U)  =J(r2-R2)-'/26(U-sR-u(r2  -  R2)l'2)*,(s)*U“)dr<L;ds.  (3.7) 


We  now  integrate  with  respect  to  r  to  find 


*(U)  =  ((U-  aR)2  +  u ,2R2)-l/2*,(*)*Mduds. 
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Care  must  be  taken  to  ensure  that  this  integral  is  evaluated  over  the  correct 
limits,  those  for  which  the  integrand  is  well  defined.  For  u>0we  need  s  <  ^ 
and  for  u>  <  0  we  have  s  >  This  domain  of  integration  is  shown  in  figure 
(2).  We  can  split  the  integral  up  into  two  parts 


*{U)  =  + 


(3.9) 
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*3(U)=  l  du  [  ((U  -  »R)2  +  R2u2)-''2*.(s)*„(u)ds.  (3.11) 

Ju=-  oo  J  t=U/R 


zU/R 


We  impose  the  conditions 


and 


$,(s)  =  $,(-a) 


(3.12) 


♦w(u>)  =  ♦„(-«).  (3.13) 

These  ensure  that  contraction  is  as  likely  as  expansion  and  that  rotation  is 
equally  likely  to  be  any  direction. 

We  use  (3.12)  and  (3.13)  to  rewrite  (3.9)  as 


rw—oo  r  t=V I R 

*(U)  =  du  ((U  -  aR)2  +  jjV)“1'»*,(s)*ll,(«t/)* 

J  u/=0  J  i=  —  oo 


+  /  du  ((U  +  sR)2  +  R2u2)-'/2i,(3)*„(u)ds.  (3.14o) 

J  ui— 0  J  •=  —  oo 


We  now  substitute  t  =  Rs/u  and  w  =  uQ/R  and  obtain 


*(U)  =  I  dSl  I  ((1  -  f)J  +  0 2r'/2*.(vt/R)*u(uil/R)dt 
K  J n=o  Jt=- oo 

u  /n=<x>  /•'=  -1 

+  /  rfn  /  (d  +  t)2  +  n2)~,/2*.(ut/fl)*w(un/fi)</t.  (3.14*) 

-'0  =  0  Jt=-oo 

Note  that  if  we  set  $,(ut/R)  =  6(ut/R)  we  recover  (1.3). 


*«  _ %  w“»  .'i  “•  V‘»  . 


.  W  V.W.s'. 
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VVe  differentiate  (3.14a)  to  obtain 


>1*  /-W-OO  r  a  —  V  /  R 

—  =  -  /  du  ((U  +  sR)2  +  R2u2)-3'2(0'  + 

Oi‘  J  3=-CC 

r^—OQ  f  3  —  —U /  R 

-  dio  I  ((U-sR)2  +  R2Lj2)-3/2(U-sR)$a(s)<i>Ju>)ds.  (3.15) 

J u/=0  j  —  oo 

VVe  can  simplify  this  expression  by  setting  s  to  s  —  2U / R  in  the  second  term 
on  the  right  hand  side.  This  yields 


oc  r  9~  —  U  f  R 


**=-  r~d*{ 

dU  Jw=0  J,= 


((U  +  sR)2  +  R2lj2)3'2 


(sR+U)(*s(s)-*,(s+2U/R))$A~-)ds. 


In  the  range  of  integration  (u  +  sR)  is  always  negative.  So  the  integral  will 
be  always  negative  provided  <$,(s)  -  $,(s  +  2u / R)  is  negative  for  s  <  -uf  R. 
If  we  make  s  positive,  using  (3.12),  this  becomes 


*A»~2U/R)  -  *,(a)  >  0. 


which  is  true  for  all  monotonically  decreasing  functions.  Then  we  have  ^  <  0 


everywhere  for  any  function  $w(*>).  Hence  the  projected  velocity  distribution 


will  once  more  be  peaked  about  U  -  0. 


If  we  relax  the  conditions  (3.17)  we  are  no  longer  assured  of  having  a 
monotonically  decreasing  projected  velocity  distribution  for  all  4>^(u.-).  If 


WWW 


Yuille 


Ullman 


$,(s)  is  linear  in  s  we  obtain  a  flat  distribution 

$(£/)  =  const.  (3.18) 

If  $*(s)  is  quadratic  in  s  we  find 

1 1  =  -2/  +  11  w«V  +  (3-19> 

which  will  only  be  negative  for  some  distributions  $w(u>). 

Thus  allowing  the  rod  to  expand  and  contract  reduces  the  strength  of  the 
result  of  Section  1.  But  if  we  make  the  reasonable  assumption  that  $,(s)  is 
at  most  linear  in  s  the  result  will  still  hold. 

f 

Section  4.  Curves  from  rods. 

The  situation  becomes  more  complex  when  we  consider  several  rods 
joined  together  to  form  a  curve.  The  results  above  show  that  for  each  rod 
individually  the  projected  velocity  distribution  is  peaked  at  zero.  If  the  rods 
are  joined,  however,  these  probability  distributions  are  no  longer  independent. 
We  now  sketch  an  argument  suggesting  that  this  loss  of  independence  does 
not  affect  the  result. 

Suppose  we  have  a  set  of  probability  distributions  Pi(x,),  i  =  1,..jV 
which  are  all  peaked  at  zero.  We  now  define  the  joint  probability  distribution 
P(x)  where  x  =  (x,,xj,  ...,x,v).  If  we  impose  no  constraints  this  distribution 


is  given  by 
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P(x)dx  =  UtP,(x,)Uidxt.  (1.1) 

Now  impose  a  consistency  constraint  x<  =  0.  We  now  have 

J  P(x)dx  =  J  Zi)n,dx,.  (4.2) 

The  Xi's  can  no  longer  vary  independently  and  the  delta  function  imposes  the 
consistency  constraint.  We  can  get  integrate  out  the  delta  function  thereby 
reducing  the  number  of  independent  variable  to  jV  -  1.  It  is  convenient  to 
choose  these  to  be  x<  -  xi+1,  for  i  =  l,...,iV  -  1.  We  can  now  write  (4.2)  as 


J  P{x)dx  =  J  U,P,(xi~  xt+1)Yl,d(x,-  xt+i  ) 


We  can  set  yt  —  x,  —  xl+j ,  i  =  1, ..., iV  —  1  and  rewrite 


(4.3) 


P(y)  =  Pi(yi  )Pi(y2)-P\-\(yN-i)P\(-yi  -  1/2  -  •••  -  y.v-i  )•  (4.4) 

It  is  straightforward  to  see  that  the  maximum  value  of  P(  y)  occurs  when  the 
y,  are  all  zero.  Thus  P  is  still  peaked  at  zero  even  with  the  constraints. 

Section  5.  An  alternative  approach. 

The  results  derived  in  the  last  few  sections  support  the  assumption  (Hil¬ 
dreth  1984)  that  the  velocity  field  along  a  contour  is  smooth.  This  assump'ion 
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is  used  to  solve  the  aperture  problem  by  prescribing  the  smoothest  possible 
velocity  field  consistent  with  the  data. 


An  alternative  approach  to  the  aperture  problem  was  taken  by  Waxman 
and  VVohn  (1986).  They  showed  that  if  the  object  was  locally  planar  and 
moving  rigidly  then,  assuming  perspective  projection,  the  local  velocity  field 
on  the  image  plane  would  be  locally  quadratic  in  the  x,y  coordinates.  They 
then  defined  regions  in  which  these  expansions  were  valid  and  checked  for 
consistency  between  these  regions.  In  these  regions  they  could  do  a  least 
squares  best  fit  to  find  the  coefficients  of  these  quadratic  polonomials,  and 
hence  the  velocity  field. 


This  approach,  however,  can  also  be  used  to  justify  the  smoothest  velocity 
field  assumption.  The  orthographic  projection  of  the  motion  of  a  rigid  body 
will  obey 


vr  =  A  +  By  4-  Cz , 


(5.1a) 


vv  =  D  +  Ex  4-  Fz, 


(5.16) 


where  A,  B,  C ,  D ,  E.  F  are  constants  and  z  is  the  (unknown)  depth  coordinate. 
If  we  also  assume  the  object  is  planar  then  z  obeys 
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z  =  px  +  qy  +  s,  (5.2) 

where  p,q,r  are  constants.  Substituting  (5.2)  into  (5.1)  gives  linear  expres¬ 
sions  for  vz  and  vy  in  terms  of  x  and  y.  So  if  we  assume  local  planarity  and 
local  rigidity  (in  the  style  of  Waxman  and  Wohn  (1986))  the  velocity  fields 
will  locally  be  linear  in  i  and  y.  The  measure  of  smoothest  velocity.  /( v), 
used  by  Hildreth  is  the  integral  along  the  curve  of  the  function 


j,  dv  dv 


(5.3) 


where  s  is  the  arc  length.  The  velocity  fields  will  be  locally  linear  if  and  only 
if  J(  v)  is  zero.  Thus  we  can  think  of  the  smoothest  velocity  field  approach  as 
a  local  method  of  assuming  local  rigidity  and  local  planarity. 


Section  8.  Conclusion. 

The  arguments  in  the  first  four  sections  of  this  paper  suggest  that  locally 
rigid,  or  semi-rigid  objects,  will  tend  to  project  a  smooth  velocity  field  in 
the  image.  Moreover,  assuming  random  motions  and  limited  expansion  or 
contraction,  this  field  will  tend  to  be  as  smooth  as  possible.  In  the  fifth 
section  we  noted  that  rigidity  of  an  object  and  local  smoothness  of  its  surface 


will  also  lead  to  a  smooth  image  motion. 
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These  arguments  support  the  view  that  maximixing  smoothness  is  a  good 
heuristic  to  use  for  motion  correspondence  and  that  it  is  a  sensible  way  to  solve 
the  aperture  problem. 
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Appendix 

We  first  describe  the  general  method  for  integrating  delta  functions. 
Suppose  we  have  an  integral  /(a, 6) 

/(a, 6)  =  /  f(x)6(x  -  x0)dx  (4.1) 

J  a 

where  6(x)  is  the  Dirac  delta  function,  f(x)  is  an  arbitrary  function,  xq  an 
arbitrary  point  and  b  >  a.  The  value  of  the  integral  is 

I(a,b)  =  f(x0),  if  zof[a,*>]  (.4.2a) 

/(a,  b)  =  0,  otherwise.  (4.26) 


This  result  can  be  generalized  to  integrals  of  form 
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J(a,b)  =  I  f(x)6(g{x)  -  c)dx  (4.3) 

J  a 

where  g(x)  is  an  arbitrary  function  and  c  an  arbitrary  number.  All  points  x, 
with  g(xt)  =  c  will  contribute  to  this  interval.  Suppose  there  is  only  one  such 
point.  If  there  are  several  we  can  divide  the  integral  up  into  regions  with  only 
one  such  point.  Consider  one  such  point  x  =  0.  The  function  g{x)  can  be 
expanded  in  a  Taylor  series  about  this  point 

g(x)  =  c  +  5((0)(x)  +  0(x2).  (.4.4) 

If  we  change  the  coordinate  to  u  where  u  =  ff'(0)x  we  can  write  the 
integral  as 

J{a,b)=  /  f(u/g'(0Mu  +  O(u2))-—.  (4.5) 

o)o  9(0) 

The  value  of  the  integral  will  depend  on  the  sign  of^'(0)-  If  it  is  negative 
the  bounds  of  the  integral  will  be  reversed  and  the  integral  will  change  sign. 
Therefore 

J(°,6)  =  /(0)]-i^,  0([a,  b]  (4.6a) 


J(a,b)  =  0,  otherwise. 


(AM) 
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We  now  consider  the  form  of  the  probability  distribution  function  for  a 
rotational  symmetric  vector  in  two-dimensional  space.  Suppose  the  function 
is  $3 {u)du.  If  it  is  rotationally  symmetric  (and  hence  depends  only  on  the 
modulus  u>  of  u)  it  can  be  written 


$z(u)d£j  =  $u(u)udud<p,  (.4.7) 

by  changing  to  radial  coordinates  w,<^>  in  the  u  space.  The  ip  component  can 
be  integrated  out  to  give  a  distribution  lo$u(u)(Lj. 
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